Data Visualization for Education

1. Review data visualization principles
2. Look at applications in education data
3. Challenges in an LEA/SEA
4. Best practices and advice
5. What tools to use

qplot(hp, mpg, data = mtcars) + theme_dpi()

There are a few things that all charts need. There are sometimes strong cases to deviate from these, but they are good rules of thumb.

• Axis labels and a chart title
  • These make the chart self-explanatory
• A legend
  • What is the unit in the graphic?
• A scale
  • How are units mapped to the visual space
• Annotations
  • Author and data source (depending on distribution)

Statistics we can use

Aesthetics for Mapping

Mapping Possibilities

Think like a map. Data density and easy interpretability.

• Focus on the content
• Use best practices
• Understand the limitations
• Experiment and iterate!

• The type of data we look at determines the way it should be presented
• It always starts with the data
• Let's review the data types
• Categorical
• Ordinal
• Interval
• Continuous

How do we display a ton of data--tens or hundreds of thousands of observations?

1. Summarize the data
   • Display summary statistics visually depicting the central tendency and spread of data
2. Plot the raw data
   • Annotate wisely to display the main message
3. Model the data
   • Use a statistical model to summarize features of the data

Let's look at some examples of this.

• The most simple summaries are measures of central tendency, most easily understood
• It is important to look at the spread of data too though
• If time is of interest, we are interested in trends

But, what's wrong with this plot?

With the same space, what additional information are we providing?

How can we do even better?

We still aren't sure what the mean scale score means. Let's see a couple more additions that can realy make this useful.

Sometimes, we can get away with showing the raw data, that is, all data points. We may want to do this for a few reasons:

• the "wow" effect,
• because it is easier,
• or because it looks better aesthetically.

How could it be done?

• Without reducing the data points we need to do three things to be successful

1. Spread the data out
   • These points overlap each other and make a mess
2. Reduce the ink
   • Each point has too much "weight"
3. Add Reference Points
   • 600,000 observations in one panel is not meaningful

What About This

All models are wrong. Some models are useful.

Trees are ways to divide up the variation in a dataset and rank the explanatory values.

We can combine these features.

• Facets with smoother lines for references
• Summary plots with raw data in the background
• Reference lines and group comparisons

• Annotation
• Labeling
• Lots of data-ink

• Have a properly chosen format and design
• Use words, numbers and drawing together
• Reflect a balance, a proportion, relevant scale
• Display an accessible complexity of details
• Have a narrative quality, tell a story
• Avoid content-free decoration (Tufte's proverbial chartjunk)
• Draw in a professional manner with an eye on the technical details
• Remember the map

qplot(hp, mpg, data = mtcars) + theme_tufte()

qplot(hp, mpg, data = mtcars, color = factor(cyl)) + theme_excel() + scale_color_excel()

qplot(hp, mpg, data = mtcars, color = factor(cyl)) + theme_stata()

We have a number of other techniques we can use beyond simple charts.

• Animations
• Interactive demos
• Summary tables
• Videos
• Web sites

The technology you choose to do visualizations is largely a question of personal productivity, but with some important caveats:

• In the future, more and more content is going to be delivered in a paperless world, so pick a technology that can leverage web/tablet/phone interfaces
• Different technologies are useful for different levels of finish and polish; Adobe Illustrator is great for publication quality graphics, R is a great tool for rapidly prototyping different visualizations
• Chose a technology that best serves your consumer, not you are the producer. Charts are a service to the consumer, not to the creator.

Visualize some education data. Imagine we have the following dimensions and want to present more of them on a plot like that on the right.

print(sessionInfo(), locale = FALSE)

R version 2.15.2 (2012-10-26)
Platform: x86_64-w64-mingw32/x64 (64-bit)

attached base packages:
[1] grid      stats     graphics  grDevices utils     datasets  methods  
[8] base     

other attached packages:
 [1] Formula_1.1-0        mvtnorm_0.9-9994     partykit_0.1-4      
 [4] mgcv_1.7-22          vcd_1.2-13           colorspace_1.2-0    
 [7] MASS_7.3-22          ggthemes_1.3.1       eeptools_0.1        
[10] mapproj_1.2-0        maps_2.3-0           proto_0.3-10        
[13] plyr_1.8             ggplot2_0.9.3        stringr_0.6.2       
[16] knitr_0.9.1          slidifyLibraries_0.1 markdown_0.5.3      
[19] whisker_0.3-2        slidify_0.3.3        devtools_0.8        

loaded via a namespace (and not attached):
 [1] dichromat_1.2-4    digest_0.6.0       evaluate_0.4.3    
 [4] formatR_0.7        gtable_0.1.2       httr_0.2          
 [7] labeling_0.1       lattice_0.20-10    Matrix_1.0-10     
[10] memoise_0.1        munsell_0.4        nlme_3.1-106      
[13] parallel_2.15.2    RColorBrewer_1.0-5 RCurl_1.95-3      
[16] reshape2_1.2.2     scales_0.2.3       splines_2.15.2    
[19] survival_2.37-2    tools_2.15.2       yaml_2.1.5        

• Tufte, Edward. 1992. The Visual Display of Quantitative Information. Graphics Press.
• Unwin, Theus, and Hofmann. 2006. Graphics of Large Datasets: Visualizing a Million. Springer.
• Wilkinson, Leland. 2005. The Grammar of Graphics. Springer.
• Ware, Colin. 2012. Information Visualization: Perception for Design. 3rd Edition. Morgan Kaufmann.
• Cleveland, William. 1994. The Elements of Graphing Data. Hobart Press.
• Cleveland, William. 1993. Visualizing Data. Hobart Press.
• Few, Stephen. 2009. Now You See It: Simple Visualization Techniques for Quantiative Analysis. Analytics Press.
• Few, Stephen. 2012. Show Me the Numbers: Designing Tables and Graphs to Enlighten. Analytics Press.
• Yau, Nathan. 2011. Visualize This: The FlowingData Guide to Design, Visualization, and Statistics. Wiley.
• Few, Stephen. 2006. Information Dashboard Design: The Effective Visual Communication of Data. O'Reilly Media